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. ' Although unbiasedness is a basic property of a good test, many tests on vector parameters or 

tC , scalar parameters against two-sided alternatives are not finite-sample unbiased. This was already 

jrt ' noticed by Sugiura [Ann. Inst. Statist. Math. 17 (1965) 261-263]; he found an alternative against 

which the Wilcoxon test is not unbiased. The problem is even more serious in multivariate 
models. When testing the hypothesis against an alternative which fits well with the experiment, 
it should be verified whether the power of the test under this alternative cannot be smaller 
than the significance level. Surprisingly, this serious problem is not frequently considered in the 
^ ■ literature. 

^^ ' The present paper considers the two-sample multivariate testing problem. We construct sev- 

^'V' . eral rank tests which are finite-sample unbiased against a broad class of location/scale alterna- 

tives and are finite-sample distribution-free under the hypothesis and alternatives. Each of them 
is locally most powerful against a specific alternative of the Lehmann type. Their powers against 
CO ■ some alternatives are numerically compared with each other and with other rank and classical 

^^ ' tests. The question of affine invariance of two-sample multivariate tests is also discussed. 
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c^ ■ 1. Introduction 



1.1. Two-sample multivariate tests 

A frequent praetieal problem is that we have two data clouds of p-dinicnsional observa- 
tions with generally unknown distributions F and G, and we wish to test the hypothesis 
that they both come from the same distribution F = G, continuous but unknown. Desir- 
able properties of a test of such a hypothesis H are: (i) being distribution-free under H; 
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(ii) being afBne invariant with respect to changes of coordinate system; (iii) being consis- 
tent against any fixed ahernative; and (iv) being finite-sample unbiased against a broad 
class of alternatives of interest. Unfortunately, a test satisfying all these conditions does 
not exist in the multivariate setup. 

Many authors have tried to attack this problem, emphasizing some of the above prop- 
erties. Their ideas were often concentrated either on some geometric entities of the data 
clouds or on the affine invariance of the testing problem. Naturally, the ranks or the 
signed ranks of geometric entities of data are invariant under many transformations and 
provide a useful and simple tool for testing. The papers extending methods based on 
ranks or other nonparametric methods to the multivariate setup use data depths, Oja 
medians, multivariate sign functions and other tools. In this context, we should mention 
the papers by Chaudhuri and Sengupta [5], Choi and Marden [6, 7], Hallin and Pandav- 
eine [13], Hetmansperger et al. [17], Liu [21, 23], Liu and Singh [24], Oja and Randies [31], 
Oja et al. [30], Puri and Sen [33], Randies and Peters [34], Topchii et al. [40], Tukey [41], 
Zuo and He [43] and a recent excellent review by Oja [29]. 

Other authors have constructed various permutation tests: Bickel [3], Brown [4], Hall 
and Tajvidi [14], Neuhaus and Zhu [26], Oja [28], Wellner [42] and others. Tests based on 
distances between observations were considered by Baringhaus and Franz [2], Friedman 
and Rafsky [8], Hcnzc [15], Maa et al. [25], Roscnbaum [35] and Schilling [37]; the latter 
also compared the simulated powers of his test with that of the Kolmogorov-Smirnov 
two-sample test. 

The proposed tests were typically consistent against distant alternatives and some of 
them were affine invariant. The authors often derived the asymptotic null distributions of 
the test criteria and some derived the asymptotic powers under contiguous alternatives. 
Many authors illustrated the powers on the simulated data, often normal, and compared 
them with the power of the Hotelling T^ test. However, only in exceptional cases did 
they check whether the test was unbiased against alternatives of interest. 

1.2. Unbiased tests 

Let $ be a test of hypothesis {H: distribution F of random vector X belongs to the 
set H} against the alternative {K: distribution of X belongs to the set K,}. Consider 
the tests of size a,0 < a < 1, where a is the chosen significance level, that is, the tests 
satisfying sup^g^Ei^[$(X)] < a. The test <& is unbiased if it satisfies 

sup Ef['1"(X)] < a and inf Ef[$(X)] > a. 
Feu -P'e/c 

This is a natural property of a test; it means that the power of a test should not be 
smaller than the permitted error of the first kind. If the test rejects the hypothesis with 
a probability less than a under the alternative of interest, then we can hardly recommend 
the test to the experimenter. Note that if there exists a uniformly most powerful test, 
then it is always unbiased. If the optimal test of size a does not exist because the family 
of a-tests is too broad, then we should restrict ourselves to a pertinent subfamily of 
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tests, and the family of unbiased tests of size a is the most natural subfamily. We refer 
to Lehmann's monograph [22] for an excellent account of unbiased tests. 

Many tests criteria have asymptotic normal distributions under the hypothesis as well 
as under the local alternatives - these are asymptotically locally unbiased. However, the 
practice always works with a finite number of observations. The asymptotic distribution 
only approximates well the central part of the finite-sample distribution; elsewhere, it 
can stretch the truth and sometimes is only valid for a huge number of observations. To 
calculate the finite-sample power of a test is sometimes difficult; in any case, as a first step, 
we should be sure that the test is unbiased against the alternatives under consideration, at 
least locally in a neighborhood of the hypothesis. Unfortunately, many authors have not 
specified the alternatives against which their tests are (locally) unbiased. The alternative 
is typically more important for an experimenter than the hypothesis because it describes 
his/her scientific conjecture. Some papers, for example, [18, 19, 38, 39], show that the tests 
are not automatically finite-sample unbiased. While the univariate two-sample Wilcoxon 
test, for example, is always unbiased against one-sided alternatives, it is generally not 
unbiased against two-sided alternatives, even not with equal sample sizes (see [38, 39]). 
The test is locally unbiased against two-sample alternatives only under some conditions 
on the hypothetical distribution of observations (e.g., when it is symmetric). Amrhein [1] 
demonstrated the same phenomenon for the one-sample Wilcoxon test. Hence, the finite- 
sample unbiasedness of some tests cited above, and others described in the literature, is 
still an open question. 

To illustrate this problem more precisely, consider a random vector X = (^i, ■ ■ . ,^n) 
with distribution function F{:>c,9),9 G C M^, and density /(x, 0) (not necessarily 
Lebcsgue), which has bounded third derivatives in components of in a neighborhood 
of 9q and a positive definite Fisher information matrix. We wish to test Ho .O = Qq 
against the alternative 'K.:6 ^Oq using the test $ of size a, that is, EeQ[$(X)] = a. We 
then have the following expansion of the power function of $ around Oq (see [19]): 



E,,$(X) =a + {e- 0o)Te,„ |$(X)ffilM 

+ i(0-0o)^E,„|$(X)&M^(0_0„) + O(||0-0or), 



(1.1) 



where 



(^•^^"••K^ ^l' «-"" 



92/(x,0) 



86 J dOk 



j.k=l 



The test (f> is locally unbiased if the second term on the right-hand side of (1.1) is non- 
negative. If is a scalar parameter and we consider the one-sided alternative K:0 > 0Oi 
then there always exists an unbiased test. However, the alternative for a vector 6 is only 
two-sided and the local unbiasedness of $ is guaranteed only when 
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However, (1.2) is generally true only for / satisfying special conditions, which cannot 
easily be verified for unknown /. If the test <I> does not satisiy (1.2), then the second 
term in (1.1) can be negative for some and hence the power of $ can be less than a. We 
refer to Grose and King [10], who imposed condition (1.2) when constructing a locally 
unbiased two-sided version of the Durbin- Watson test. 

1.3. Outline of the paper 

We shall propose three classes of multivariate two-sample tests, based on the ranks of 
suitable distances of multivariate observations. One test is based on the ranks of distances 
of observations from the origin, while the others are based on the ranks of their interpoint 
distances. The natural alternatives state that either the distances of the second sample 
from the origin are stochastically larger than those of the first sample, or that the dis- 
tances of the Y's from the X's arc stochastically larger than those of the X's from each 
other. The proposed tests are unbiased because our natural alternatives are one-sided (in 
the distances). Moreover, the proposed rank tests are distribution- free under the hypoth- 
esis as well as under alternatives of the Lehmann type, and they are consistent against 
general alternatives (properties (i), (iii) and (iv)). The distribution- free property is im- 
portant because we need not determine the distribution of distances when performing 
the test. 

The tests are described in Section 2, which starts with some invariance considerations 
(cf. desired property (ii) of the test). It is shown that the proposed tests based on the 
ranks of distances, as well as the Liu-Singh [24] tests based on the ranks of depths, are 
distribution-free against some monotone alternatives of the Lehmann type with respect 
to which they are finite-sample unbiased. Section 3 describes the contiguity of these al- 
ternatives with respect to the hypothesis, which enables us to derive the local asymptotic 
powers of the tests. The powers of tests arc compared numerically under finite N^ as well 
as asymptotically under A^ — > oo. The proposed tests are also compared with the tests 
of Liu and Singh, and of [17], using a reference to numerical results of [43]. In Section 4 
we compare the empirical powers of the proposed tests with those of the Hotclling test 
under the bivariate normal and bivariate Cauchy distributions. The contiguity of the 
Lchmann-type alternatives is proved in the Appendix. 

2. Multivariate two-sample rank tests 
2.1. Remarks to afRne invariance 

Consider two independent samples X = (Xi, . . . , X,„) and y = (Yi, . . . , Y„) from two 
p-variatc populations with continuous distribution functions F^P' and G^^' , respectively, 
with respective means and dispersion matrices fi^, /Xj and Si, S2. The problem is to test 
the hypothesis Hq : F^p^ = G^^-' (along with fi^ = /^a, Si = S2) against an alternative Hi, 
where either (/Xi,Si) 7^ (/i2,S2) or where F'^^ and G^^' are not of the same functional 
form. We denote by (Zii,. . . ,Zn) the pooled sample with Z^ = Xi,i = l,...,m, and 
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Zrn+j = Yj ,j^l,...,n,m + n = N. The hypothesis and the alternative are invariant 
under afBne transformations: 

Q ■.{Z^' a + BZ} with a G M^and B a nonsingular p x p matrix. (2-1) 

More precisely, the hypothesis and alternative remain true even after the transformation 
g £ G oi the data, and we are looking for invariant tests whose criteria are invariant with 
respect to g (z Q. The invariant tests depend on the data only by means of a maximal 
invariant oiQ [22]. Obenchain [27] showed that the maximal invariant with respect to G is 

T(Zi,...,Zw) = [(Z,-Z^)TV^i(Z,-Zjv)]f,=i, 

(2.2) 

N N 

where Z^v = ^ ^ Z„ Vjv = ^(Z, - ZAr)(Z, - Z^)^. 

Then, T(Zi, . . . , Zjv) is the projection matrix associated with the space spanned by the 
columns of the matrix [Zi — Z^r, . . . , Zjv — Zjv]- In particular, under a= 0, the maximal 
invariant of the group 



go:{Z^BZ} is equal to To(Zi, . . . , Z^) = [Z7(V^)-iZ ^^ 



N 



^^^'^■^" (2.3) 



where V^^^ZiZ,^ 



i=l 

Moreover, one of the maximal invariants with respect to the group of shifts in location 

Qi-.Z — ^ Z + a, a e M^, (2.4) 

is Ti(Zi,. . .,ZAr) = (Z2 — Zi,. . .,ZAr — Zi). 

The well-known two-sample Hotelling T^ test is based on the criterion 

'^Ji = (^m ^ Y„) V^(X,r„— Y„). (2.5) 

The test is invariant with respect to Q and is optimal unbiased against two-sample 
normal alternatives with ^i^ ¥" A*2 ^^.d Si = S2. Its asymptotic null distribution, when 
both sample sizes TO,n tend to infinity, does not depend on the normality. If m,n— > 00 
and — — > 1, then the asymptotic distribution of 7^„ does not change even when Si 7^ S2, 
but only in this case (see [22]). Its finite sample unbiasedness is not guaranteed under 
a nonnormal underlying distribution. 

If we wish to construct a nonparametric two-sample test which is distribution-free 
and affinc invariant with respect to Q, we expect it to be based on the ranks of 
some components of T in (2.2) or on the relevant empirical Mahalanobis distances of 
points Zi, Zj, 1 < i, J < N. The ranks of distances are invariant with respect to continu- 
ous increasing functions of the distances; however, in our case, the data themselves are 
transformed, rather than their distances. The proper form of the rank test criterion based 
on the Mahalanobis distances and its unbiasedness against alternatives of interest is the 
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subject of a forthcoming study. The rank tests considered in the present paper are easier 
but invariant only with respect to Qi, not to the change of the origin. On the other hand, 
the proposed tests enjoy the properties (i), (iii) and (iv) mentioned above. 

2.2. Liu and Singh rank sum test 

An interesting test of Wilcoxon type, based on the ranks of depths of the data, was 
proposed by Liu and Singh [24]. Being of Wilcoxon type, this test is locally most powerful 
against some alternatives of the Lehmann type. Its asymptotic distributions under the 
hypothesis and under general alternative distributions F, G of depths was derived by Zuo 
and He [43]. 

Let D{y; H) denote a depth function of a distribution H evaluated at the point y e MP. 
Liu and Singh [24] considered a parameter, called a quality index, defined as 

= F{D{X; F(p)) < D{Y; F^p^)\X - F^p\Y - G^p^}, 

where R{y;F^P^) =Ff{D{X;F'^p^) < D{y;F'^P^),y &W, and showed that ii D{X;F^p^) 
has a continuous distribution, then Q{F'^p\f'^p^) = ^. They then tested the hypothesis 
Q{F'-p\G'^p^) = \ against the alternative Q{F'-p\G'^p^) ^ \ using the Wilcoxon-type cri- 
terion based on the empirical distribution functions F^ and Gn of samples of sizes m 
and n respectively: 

t 1 " 

g(Fm,G„)= / i?(y;f„)dG„(y) = -^i?(Yj;i^„). 

If the distribution of depths is symmetric under F'^'p^ = G^p\ then the test rejecting 
provided |Q(i^„,G„) - ^j > Ga/2 is locally unbiased against Q(f (p),G(p)) ^ \. Under 
a general distribution of depths, only the one-sided test with the critical region 

QyFrm G„) ^ 2 '* ^" 

is unbiased against the one-sided alternative Q{F^p\G''P^) > ^; however, this alternative, 
one-sided in depths, has a difficult interpretation with respect to the distributions F^p") 
and G'-P^ of original observations X and Y, respectively Generally, the test is not finite- 
sample unbiased against F ^ G, not even locally. The unbiasedness can be guaranteed 
only in some cases, for instance, if the hypothetical distribution of depths is symmetric. 

2.3. Rank tests based on distances of observations 

We shall test the hypothesis of equality of distributions of two samples against alterna- 
tives that some distances are greater than others; because such alternatives are one-sided, 
they make the tests unbiased. 
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Choose a distance L = L(-, •) in Rp taking nonnegative real values. Let 

2^ = (Zi, . . . , Zat) = (Xi, . . . ,X„j, Yi, . . . , Y„) 

denote the pooled sample, where N = m + n, and consider the matrix of distances L^r = 
[^jfc]ffe=ii where £ik = L{Zi,Zk)- We can construct simple rank tests based on L^r in 
three different ways; 

(i) Simple rank test, but not invariant with respect to Q or Qi. Consider the vector 

(li,...,^~jv), 4. = L(0,Zfe), fc = l,...,iV, 

of distances of observations from the origin. The vector (£i,...,£m) is then 
a random sample from a population with a distribution function F (say), while 
{(-m+iT ■ ■ i^n) is a random sample from a population with a distribution func- 
tion G. Assume that the distribution functions F and G are absolutely continuous. 
Under hypothesis HqiF'^p' = G^'p\ the distribution functions F and G coincide, 
that is, they satisfy the hypothesis Hq :F =G which states that {(-k, fc = 1, . . . , N} 
satisfy the hypothesis of randomness. If Hq is not true, then Hq is not true either. 

Denote by {Ri,...,Rn) the respective ranks of {£k,k = I, . . .,N}. Under 
the hypothesis, the vector of ranks has the uniform distribution on the set of 
permutations of the numbers 1, . . . , iV. Because {£k, fc = 1, . . . , m} and {ik, k = 
m + 1, . . . , N} are random samples, under the hypothesis, as well as under the 
alternatives, every two-sample rank test will depend only on the ordered ranks 
/j(™+i) < . . . < ij(^) of the second sample. However, although invariant with re- 
spect to increasing continuous functions of {ii,. . .,(.n)-i such a test would not 
be invariant with respect to the groups of transformations (2.1) or (2.3), even if 
ik = ||Zfc|| is the Euclidean distance. 

The linear rank test is based on the linear rank statistic 



N 
'AT 



7V-1/2 Y, ^N{R^k) (2.6) 



with the scores aAr(l), . . .,ajv(iV) generated by a nondecrcasing score function 
ip: (0, 1) I— >■ M in either of the following two ways: 

aN{k)^n^{UN:k)), fc = l,...,A^, (2.7) 



or 

«^(fc) = ^(|^), fc = l,...,iV, (2.8) 

with [/jv:i < • • • < Un:N being the order statistics of the sample from the uni- 
form R(0, 1) distribution. The test based on (2.6) is distribution-free, that is, the 
null distribution of Sn does not depend on the unknown F = G under Ho . Its 
asymptotic properties follow from [11] or [12]. 
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(ii) Conditional rank test, invariant with respect to Qi . Assuming that m> p, choose 
a suitable basis (X^^ , . . . , X^ ) = Xp of {X^, 1 <i < m}; the choice of basis Xp can 
follow various aspects. Consider the set oi {m + n — p) x p distances 

{^*,,fc = -^(^ii , Zfc), fc = 1, . . . , TV, fc 7^ ii, . . . , ip}, j = l,...,p. 

Then, for a fixed ij, 1 < j < p, and conditionally given Xp, the vector {£*, ^.,k = 
1, . . . , ?7i, fc 7^ ii , . . . , ip} is a random sample from a population with a distribution 
function F(z|Xp) = F (say), while {£*, i^,k = m + 1,. . ., N} is a random sample 
from a population with a distribution function G(z|Xp) = G. Assume that the 
distribution functions F and G are absolutely continuous. Let 

Ti-ij = {Rij.k,k^ l,...,N,k^ii,...,ip) 

denote the ranks of £* j. , fc = 1 , . . . , A^, fc ^ ij , Vj = 1 , . . . , p. Every two-sample rank 

test will depend only on the ordered ranks nf^ < ■ ■ ■ < R\ of the second sam- 
ple. In particular, if L(Xj^., Zfe) =: ||Xj^. -Zfe||,fc== l,...,Af,fc7^ii,...,ip, where \\-\\ 
is the Euclidean distance, then the test based on their ranks will be invariant with 
respect to Gi in (2.4), but not with respect to Q,Qo- 

Similarly as in (i), the linear (conditional) rank test is based on the linear rank 
statistic 

N 
k—rn~\-l 

with the scores 0^(1), . . . ,aN{N ~ p) generated by a nondecreasing score func- 
tion If as in either (2.7) or (2.8). The criteria S*, ^ arc equally distributed for 
j = 1, . . . ,p under the hypothesis and under the alternatives, and are conditionally 
independent given Xp. Using only a single S*. ^ would be a loss of information, 
so we look for a convenient combination of 5* ^, . . . , 5* ^. Every convenient ho- 
mogeneous combination of 5** ^, . . . , S'* ^ leads to a rank test, conditional under 
given Xp, which is distribution- free under the hypothesis. The problem would be 
to find its null distribution, and thus the critical values, under a finite A^. The test 
based on a single S*, ^ is a standard rank test, for example, Wilcoxon, condition- 
ally given Xp, and is thus easy to perform. When we look for a similarly simple test 
based on a combination of S*.j^, 1 < j < p, it seems that the simplest possibility 

is a randomization oi S* p^,. ■ ■ , S* ^, leading to the following criterion S^'^': 

P(5W = 5*,^) = i, J = l,...,P, (2.9) 

where the randomization in (2.9) is independent of the set of observations Z. The 
following identity is true for any C: 



^(5W>C) = if]P(5*,^>C) 



P^=i 
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and the test rejects Hq for a £ (0,1) if S**-^^ > C^; eventually, it rejects with 
probability 7 e (0, 1) if 5^^) = C^, where 

(iii) Randomized rank test, invariant with respect to Qi. Similarly, for every fixed i 
and under fixed X^, 1 <i <m, we can consider the distances {1!.*^. = L(X.i, Z^.), k = 
1, . . . ,N,k ^ i}. Then, conditionally given X.^, the vector {^*;,, k = 1, . . . ,m,k ^ i} 
is a random sample from a population with a distribution function F{z\li.i) = F 
(say), while {^*^, k = m + 1, . . . , N} is a random sample from a population with 
a distribution function G{z\'Ki) = G. Assuming that the distribution functions F 
and G are absolutely continuous, we work with 

T^i — [Rill ■ ■ ■ , Ri,i-lTRi,i+l, ■ ■ ■ , RiN), 

the ranks of £*f., k — 1 , . . . , N , k ^ i . 

The linear (conditional) rank test is based on the linear rank statistic 

N 

S,N=N-^'^ J2 MR^k) (2.10) 

A;— ?n+l 

with the scores a]y{l), . . . ,aN{N — 1). 

The criteria Sin are equally distributed for i = 1, ... ,771 under the hypothesis 
and under the alternatives, although not independent. We look for a convenient 
combination of ^iat, . . . , SmN- Again, a randomization of Sin, ■ ■ ■, SmN keeps the 
simple structure of the test and is thus easy to perform. It leads to the following 
criterion, S'-^'^: 

P(5W-5,Ar) = l, z = l,...,m, (2.11) 

m 

where the randomization in (2.11) is independent of the set of observations Z. 
Again, for any C, 



m 

»(5W>c) = -Vp(5,w>c), 

m ^ — ^ 



771 

i=l 

and the test rejects Hq for ct e (0,1) if S**-^-* > Ca] eventually, it rejects with 
probability 7 € (0, 1) if 5*^' = Cq. Again, with the Euclidean distance, the test 
will be invariant with respect to Qi in (2.4), but not with respect to Q^Gq. 

Remark 2.1. The Mahalanobis distances 

Z^(V°,)-iZfc, fc = l,...,A^, (2.12) 

(X,-Zfc)^V^i(X,-Zfc) or (X,-Zfc)T(V^)-i(X,-Zfc), k^i, (2.13) 
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are not independent, but under Hq, they have exchangeable distributions; hence, un- 
der Hq, the distribution of their ranks is independent of the distribution of observations 
(is distribution- free). Moreover, (2.13) are invariant with respect to G and Go, while (2.12) 
are invariant only with respect to Go- The invariant tests based on the ranks of (2.12) 
or (2.13) will be the subject of a further study. Their structure is more complex than 
that of tests based on simple distances. 

3. Structure of the rank tests 

Let li. = {Xi,. . . ,X„i) and Y = (Yi, . . . ,y„) be two independent samples from dis- 
tributions F and G, respectively. Consider the rank test with the criterion Sn = 
N^^/^J2k=m+i'^Ni-^i)j where Ri,...,Rn are the ranks of the pooled sample Z = 
{Xi, . . . , Xmi Yi, . . . , K„). The values X^, Yj are, for example, the distances of multivariate 
observations, either from a fixed point or the interpoint distances considered condition- 
ally given the original component. We want to test the hypothesis Hq-.F = G against 
a general alternative with the (m -I- ri)-dimcnsional distribution function of the form 

m N 



'i^:\{G^l\zk) n ^A^(^'^)- (3.1) 



/C— 1 fc — 771+1 

Lehmann [20] showed that the Wilcoxon two-sample test with the score-generating func- 
tion ip{u) = 2u — 1,0 < u < 1, is the locally most powerful rank test of Hq against the 
class of alternatives with 

g'^^\z)^F{z) and G^'^(z) = Ga(^), (3.2) 

^^^^)^|(l-A)F(z) + AF^(z), zJO, (3 3) 

with < A < 1. The y's are then stochastically larger than the X's and F{z) — Ga{z) = 
A • F{z){l — F{z)); hence, the Kolmogorov distance of F and Ga is 



dK{F, Ga) = A • sup[F(z)(l - F{z))] = ^ 

z>0 4 

and the point of maximum is z = ^^^(2). 

Gibbons [9] proved that the Psi test with the scores 

is the locally most powerful rank test of Hq against the alternative (3.1) with 

G«(z) = l-(1-F(z))i+^, 



(3.4) 



G^l\z) = iFiz)y+^, A>0, z>0 
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Obviously, 

G^l\z)>Fiz)>G^l\z) 

= iF{z)y+^ Vz>OandA>0, 

hence G^ is stochastically smaller than G^ for A > 0. The Kolmogorov distance of G^ 
and G^^' is 



dK{G^^\G^l^) = sup[l - (F(z))i+^ - (1 - F{z)) 



l+Ai 



:>0 
= 1-2"'^ 

and the maximum is attained at the point z = F^^(i). The score generating function of 
the Psi test is ip{u) = Inw — ln(l — w), < u < 1. 

Similarly, Savage [36] proved that the Savage test with the critical region 

n N 

is the locally most powerful rank test of Hq against the class of alternatives (3.1) with 

G^l\z)^F{z), dl\z) = F^+^{z), z>0, A>0. (3.5) 

Again, the F's are stochastically larger than the X's, and the Kolmogorov distance 
of G^ and G^ is equal to 

dK{G'-l\dl^)=sMF{z){l-F'^{z))] 

2>0 

= A(l + A)-i-i/'^, 

whose maximum is attained at z = F^^((l + A)~^/'^). The score generating function of 
this test is (p(u) = l + lnu,0<w< 1. 

Assume that F is increasing and let Uk = F{zk),k = 1, . . .,N. Under the alternati- 
ve (3.2), the ranks i?i, . . . , Rn are also the ranks of the variables [/i, . . . , Um, Kn+i, • ■ • , V/v, 
where Vk = (1 — A)[/fc + Af/|,fc = m + 1, . . . , A^. An analogous consideration applies to the 
alternatives (3.4) and (3.5). Hence, the distribution of the ranks i?i, . . . ,Rn is indepen- 
dent of F (is distribution-free) under the hypothesis as well as under the alternatives, and 
thus the power functions of all rank tests against the alternatives (3.2), (3.4) and (3.5) are 
distribution-free. The Lehmann alternatives can be well interpreted, are flexible and can 
describe various experimental situations well. Besides the linear rank tests, we can also 
consider the two-sample Kolmogorov-Smirnov test based on the empirical distribution 
functions of the interpoint distances, for the purposes of comparison. The randomized 
Kolmogorov-Smirnov test, following a similar structure as the tests in Section 2, is also 
distribution-free. Instead of interpoint distances, we can consider the rank tests based 
on the depths using similar ideas. 
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We shall concentrate on the two-sample Wilcoxon, Psi and Savage rank tests because 
they are easy to perform, are locally most powerful and are locally unbiased against some 
alternatives of Lehmann type. The ranks are distribution-free not only under the hypoth- 
esis, but also under the Lehmann alternatives, hence the powers of the rank tests are 
independent of the distribution of the data. This is an advantage because we do not need 
to calculate the distribution of the distances. Several authors (e.g., [8, 16, 25, 35, 36]) 
considered various distances of two sets of multivariate observations from some speci- 
fied point, constructed the critical regions and verified their consistencies against distant 
alternatives. However, the questions of the finite-sample behavior of these tests, their un- 
biasedness and against which alternatives, and their efficiency against local alternatives, 
remains open. If the test is not unbiased against some alternative of interest, then its 
power can be less than the significance level, say less than a = 0.05, hence such a test is 
not suitable for verifying the hypothesis against this specific alternative. 

The sequences of alternatives (3.1) corresponding to (3.3), (3.4) and (3.5) are contigu- 
ous with respect to the sequence {ni=i ^i^i)} provided that An ~ N~^I'^Aq with Aq 
fixed, < Aq < oo, as shown in the Appendix. Hence, we are able to evaluate the local 
asymptotic powers of the tests; this is done in the next section, along with the numerical 
illustration and comparison of the tests. 

3.1. Local asymptotic powers of the tests 

We shall assume throughout that 

lini !!!f = Ae(0,l). 

Let Ui = F{Zi),i = 1,...,A^. The alternative (3.1) in the special cases (3.2), (3.4) 
and (3.5) can then be rewritten as follows: 

G^l\u)^u, &2'' (u) = {1 - A)u + Au^ , 0<w<l, 



G'-l'iu) = 1 - (1 - uy+^, G^^(u) = G{u, A) = u' 
A>0, 0<M<1. 



(3.6) 



Because A is the parameter of interest and the alternatives (3.6) are contiguous with 
respect to the sequence of hypotheses (Ili^i "i-^I^ < "i £ 1]} under An = N~^^^Ao 
(see Appendix for the proof), we can study the powers of the rank tests under alter- 
natives (3.6) without loss of generality. 
Consider the centered test criterion 



S-* =iV-i/2 



m N 

'J^Z_^^N{Rm) + j;^ 2^ aN{Rm) 



(3.7) 
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If the scores are generated by a nondecreasing score function (^ : (0, 1) (-)■ M which is 
square-integrable on (0,1), then the asymptotic distribution of (3.7) under contiguous 
ahernatives foUows from the LeCam theorems (see [11] or [12]). Namely, S'^ wih be 
asymptoticaUy normally distributed A/'(/i,cr^) with 



/i = A(l — A) / ^{U)ip [ujau, (fi (u) = 







dA 



A=0 



g(u, A) = — -^ being the density of G(u, A), 

ou 



»i 

-2 _ \/i \\ I .2, 



cr^ = A(l-A) / tp^{u)du 







The test rejects H on the significance level a provided 5^ > cr(t>^^(l — a), where $ 
is the standard normal distribution function. Hence, the asymptotic power of the test 
under the alternative K^v : An = N~^/^Ao equals 

hm PK„f^^^^>$-i(l-a)-^ 



l-<^U-\l~a)~^^ 



= l-'^U~\l-a)-^^^^^^AoJ ip{u)ip*{u)du\ 

where A^ — L (p'^{u) du. The relative asymptotic efficiency of a test S^^ with respect to 
a different test 5^2 i^ given as the ratio 

^/^)= ,3.S, 

CTl / 0-2 / 

where /i*-^-* and af are, respectively, the asymptotic mean and variance of the statistic S^i 
and /z^^^ and cr| are those of 3^2- 

Table 1 summarizes the relative asymptotic efficiencies of the Wilcoxon, Psi and Savage 
tests with respect to the locally most powerful rank test for specified Lehmann alterna- 
tives. These values are computed with the aid of (3.8). For the purposes of illustration, we 

Table 1. Relative asymptotic efficiencies under various alternatives 



Alternative 






Test 






Wilcoxon 


Psi 


Savage van der Waerden 


Median 


(3.2) 
(3.4) 
(3.5) 


1.000 
0.912 
0.750 


0.912 
1.000 
0.822 


0.750 0.955 
0.882 0.992 
1.000 0.816 


0.750 
0.584 
0.480 
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also add the van der Waerden and median tests, and their relative asymptotic efficiencies 
with respect to the locally most powerful rank tests. 

For the next illustration, consider the Lehmann alternative (3.2) and compare the 
locally most powerful Wilcoxon test (the score function ip{u) = 2u— l,0<w< 1) with 
the Kolmogorov-Smirnov test. The asymptotic power of the Wilcoxon test against K^r 
equals 



lim 

min(?n,n)- 



A(l-A) 



-1/2 



SN><^'\l-a)\K 



N 



= l-$U>"i(l-a)-Ar 



A(l-A) 



(3.9) 



For small values Aq, it can be further approximated in the following way: 



A(l-A) 



-1/2 



SN><^~\l-a)\K 



N 



;a + Ao-$^($-i(l-a)) 



A(l-A) 



(3.10) 



Let us now consider the Kolmogorov-Smirnov test against alternative (3.2). Let Fm 
and G„ be the respective empirical distribution functions of samples Xi , . . . , X,„ and 
Yi,. . . ,Yn. Then, by Hajek et al. [12], Theorem VI.3.2, we have 



lim I 

m,n— >oo 



n + m^szR 



SVi]i{Gn{x) - F„i{x)) > 



;loga|KAr 



= pf sup (S(«) + AoVA(1-A)u(1-«))> J-ilogaV 

where B(u) is a Brownian bridge. The last probability cannot easily be calculated ana- 
lytically. Hence, we resort to a linear approximation around the point Aq = and get 



sup {B{u) + Ao v/A(l - X)u{l - u)) > W-i loga ) 

0<M<1 V ^ / 



1 



(3.11) 



a + 2Aov/A(l-A)a\/--loga / {2u- l)ip{a,u)d 



where 



-1. 



ipia, u) = 2$ , ,_, , 

V Vu(l-u) / 

'crs (for a — 0.05) of the \ 
the Kolmogorov-Smirnov test (As.KS) computed from (3.9) and (3.11); these powers are 



Table 2 gives the asymptotic powers (for a — 0.05) of the Wilcoxon test (As.W) and 
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Table 2. Comparison of the empirical powers for various sample sizes and of the local asymp- 
totic powers of the Wilcoxon and Kolmogorov-Smirnov tests against the alternative (3.3) 



Ao 




Obs.W, 


m = n = 




As.W 




Obs.KS, 


m = n — 




As.KS 




30 


100 


500 


1000 


30 


100 


500 


1000 




0.0 


0.050 


0.050 


0.050 


0.050 


0.050 


0.036 


0.039 


0.048 


0.048 


0.050 


0.1 


0.052 


0.053 


0.053 


0.053 


0.053 


0.038 


0.040 


0.050 


0.052 


0.053 


0.2 


0.056 


0.056 


0.056 


0.056 


0.056 


0.040 


0.043 


0.053 


0.054 


0.055 


0.3 


0.059 


0.059 


0.059 


0.059 


0.060 


0.042 


0.046 


0.056 


0.057 


0.058 


0.4 


0.063 


0.064 


0.063 


0.063 


0.063 


0.044 


0.050 


0.059 


0.060 


0.061 


0.5 


0.067 


0.066 


0.067 


0.066 


0.067 


0.047 


0.052 


0.063 


0.063 


0.063 


0.6 


0.069 


0.069 


0.071 


0.071 


0.071 


0.049 


0.055 


0.066 


0.067 


0.066 


0.7 


0.076 


0.074 


0.074 


0.075 


0.075 


0.053 


0.057 


0.069 


0.070 


0.069 


0.8 


0.077 


0.079 


0.079 


0.080 


0.079 


0.054 


0.061 


0.073 


0.074 


0.072 


0.9 


0.081 


0.083 


0.083 


0.082 


0.083 


0.057 


0.063 


0.076 


0.077 


0.074 


1.0 


0.085 


0.088 


0.087 


0.088 


0.088 


0.060 


0.067 


0.080 


0.081 


0.077 


2.0 


0.141 


0.142 


0.141 


0.143 


0.143 


0.100 


0.107 


0.126 


0.131 


0.104 


3.0 


0.214 


0.217 


0.215 


0.218 


0.218 


0.155 


0.165 


0.185 


0.193 


0.131 



compared with empirical powers (Obs.W, Obs.KS) obtained by simulations of 30, 100, 
500 and 1000 observations in both samples. The simulations were carried out in the R 
programming language using 500000 replications under the alternative (3.3), where F 
denotes the distribution function of the uniform R(0, 1) distribution. We recall that 
the powers of rank tests under Lchmann alternatives are also distribution-free for finite 
samples. 

The asymptotic approximation (3.9) of the power of the Wilcoxon test is already very 
good for m ~ n = 100. Unfortunately, the linear approximation (3.11) of the power of 
the Kolmogorov-Smirnov test only works in a local neighborhood of the null hypothesis 
as the power function increases exponentially. Even for small values of Aq, the approxi- 
mation (3.11) of the power of the Kolmogorov-Smirnov test is very good only for large 
sample sizes. 

Table 3 compares the slopes in linear approximations of asymptotic powers of the 
Kolmogorov-Smirnov and Wilcoxon tests, given in (3.10) and (3.11), under various sizes 
of the tests. The first column gives the size of the test, the second column the slope for 
the Kolmogorov-Smirnov test (K-S), the third column gives the slope for the Wilcoxon 
test and the last column gives the ratio of the two slopes. 



4. Numerical comparison of Hotelling- 
Wilcoxon-type tests 



and 



The empirical powers of the Hotelling T^ and Wilcoxon two-sample tests are compared 
under bivariate normal and Cauchy distributions with various parameters; the Wilcoxon 
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Table 3. Slopes of the Kolmogorov-Smirnov and 
Wilcoxon tests at various levels of significance 



a 


K-S 


Wilcoxon 


Wilcoxon/K-S 


0.001 


0.001 


0.002 


2.070 


0.010 


0.009 


0.015 


1.680 


0.025 


0.022 


0.034 


1.500 


0.050 


0.044 


0.059 


1.350 


0.100 


0.086 


0.101 


1.180 



test of type (2.10), (2.11) is based on the ranks of the Euchdean interpoint distances. 
The Hotelhng test distinguishes weU two normal samples contrasting in locations, even if 
they also differ in scales. However, in some situations, the Wilcoxon test even competes 
well with the Hotelling test, namely, when either the samples differ only moderately 
in locations or when they differ considerably in scales. This is illustrated by Table 4, 
which provides empirical powers of Hotelling and Wilcoxon tests for a comparison of two 
bivariate normal samples. The sample sizes are m = n = 10, 100, 1000 and the simulations 
are based on 10 000 replications. The first sample always has distribution A/'2(/X]^, Si) with 
iJLi = (0, 0)^ and Si = Diag{l, 1}, while the second sample has A/2(M2j ^2) with various 
parameters. 

We also refer to the simulation study of [43] which compared the empirical powers of the 
Liu-Singh rank-sum test (Q) based on the depths, the Hotelling and the Hetmansperger 
et al. [17] tests for two bivariate normal samples. Under normality, the Q-test mostly 
dominates the other two tests, as well as the Wilcoxon test based on interpoint dis- 
tances. However, the (local) unbiasedness of the Q-test against two-sample alternatives 
is doubtful under asymmetric distributions of the depths, while a one-sided alternative 
in depths has a difficult interpretation in the original data. 

Table 5 presents the empirical powers of the tests comparing two samples from the 
bivariate Cauchy distributions. The first sample X has a two-dimensional Cauchy dis- 
tribution with independent components. The second sample Y is obtained as a random 
sample Y* from the two-dimensional Cauchy distribution with independent components, 
independent of X, transformed to Y = /x + crY* for certain shifts fi and scales a. The 
results are based on 10 000 replications. The Wilcoxon test is far more powerful than the 
Hotelling test, already under a small shift. The Hotelling test fails completely if /x = 
but cr 7^ 1, while the Wilcoxon test still distinguishes well the samples. The Wilcoxon test 
also dominates the Hotelling test in other situations. 

The rank tests based on interpoint distances are distribution-free, both under the 
hypothesis and under the Lehmann alternatives, while the exact distribution of the dis- 
tances can remain unknown when performing the tests. The tests are locally unbiased 
against one-sample alternatives. If the interpoint distances are replaced with other scalar 
characteristics which arc symmetrically distributed under the hypothesis, then the tests 
are also locally unbiased against the two-sample alternatives. The Lehmann alternatives 
reflect the practical situations well. 
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Table 4. Powers of two-sample Hotelling T^ test (H) and of two-sample Wilcoxon test (W) 
based on distances for various m — n and a = 0.05. The first sample always has A2(/Xi,5]i) 
distribution with /Xj — (0,0)^ and Si =Diag{l,l}. The second sample has jV2(fJ-2,'^2) with 
various /i2,S2 specified in the first column 



Second sample 


Test 


m, = n = 10 


m = n= 100 


m^n^ 1000 


/^2 = (0,0)^ 


H 


0.0471 


0.0481 


0.0493 


S2 = Diagjl, 1} 


W 


0.0457 


0.0505 


0.0487 


/X2 = (0.2,0.2)^ 


H 


0.0771 


0.4115 


1.0000 


Sa = Diagjl, 1} 


W 


0.0520 


0.1715 


0.6458 


M2 = (0.5,0.5)"^ 


H 


0.2318 


0.9962 


1.0000 


S2 = Diagjl, 1} 


W 


0.1085 


0.5701 


0.8617 


/l2 = (0,0)^ 


H 


0.0659 


0.0561 


0.0452 


S2 = Diag{0.1,0.1} 


W 


0.7994 


0.9998 


1.0000 


/^2=(o,or 


H 


0.0653 


0.0456 


0.0530 


S2 = Diag{0.2,0.2} 


W 


0.4851 


0.9932 


1.0000 


M2 = (0,0r 


H 


0.0521 


0.0521 


0.0463 


S2 = Diag{0.5,0.5} 


W 


0.1182 


0.7034 


0.9968 


/l2 = (0,0)^ 


H 


0.0531 


0.0530 


0.0514 


S2 = Diag{1.5,1.5} 


W 


0.0656 


0.2881 


0.8525 


M2 = (0,0)^ 


H 


0.0552 


0.0518 


0.0508 


S2 = Diag{2,2} 


W 


0.0999 


0.5395 


0.9670 


/i2 = (0,0r 


H 


0.0572 


0.0546 


0.0521 


S2 = Diag{1.0,0.2} 


W 


0.1029 


0.6568 


0.9936 


/X2 = (0.1,0.1)^ 


H 


0.0553 


0.1266 


0.7897 


S2 = Diag{l. 1,1.1} 


W 


0.0491 


0.0932 


0.4232 


/X2 = (0.1,0.1)^ 


H 


0.0601 


0.1167 


0.7183 


S2 = Diag{1.5,1.5} 


W 


0.0667 


0.3182 


0.7690 


/i2 = (0.2,0.2)^ 


H 


0.0742 


0.3656 


1.0000 


c^i = l,cr2 = 1.5 


W 


0.0548 


0.2246 


0.6907 


/i2 = (0.2,0.2)^ 


H 


0.0710 


0.3402 


0.9994 


S2 = Diag{1.5,1.5} 


W 


0.0668 


0.3551 


0.7597 



Appendix: Contiguity of Lehmann's alternatives 



Let {-Pati, ■ • ■ , Pnn} and {Qni, ■ ■ ■ , Qnn} be two triangular arrays of probability mea- 
sures defined on the measurable space {X,A), and let P^ = JJi^iPNi and Q}^ = 

Y[i=i Qni denote the respective product measures, A^ = 1, 2, Further, denote by pNi 

and QNi the respective densities of PNi and Qni with respect to a cr-finite measure /i^, 
which can also be ^i = Pni + Qni, i = 1, . . . , iV. 
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Table 5. Powers of two-sample Hotelling T^ test (H) and two-sample Wilcoxon test (W) based 
on distances for various m = n and a = 0.05. The first sample X always has the two-dimensional 
Cauchy distribution. The second sample Y is obtained as Y = fi + aY* , where Y* is generated 
as a two-dimensional Cauchy distribution independent of X. Values of m, n, /i and a are specified 
in the first column 



Second sample 


Test 


m — n = 10 


?n = n = 25 


m = n = 100 


m = n= 1000 


fj.^{0,Of 


H 


Q.0f9f 


0.0156 


0.0171 


0.0217 


a = 1 


W 


0.0450 


0.0478 


0.0510 


0.0442 


/I = (0.2, 0.2)^ 


H 


0.0227 


0.0232 


0.0227 


0.0174 


O" = f 


W 


0.0468 


0.0536 


0.0874 


0.3925 


/I =(0.5, 0.5)^ 


H 


0.0408 


0.0404 


0.0414 


0.0361 


O" = f 


W 


0.0664 


0.1115 


0.2937 


0.7470 


M=(i,ir 


H 


0.f038 


0.1193 


0.1260 


0.1226 


O" = f 


W 


0.f2f9 


0.2710 


0.6235 


0.8893 


M=(5,5)'^ 


H 


0.7387 


0.7535 


0.7683 


0.7772 


a = 1 


W 


0.7574 


0.9441 


0.9782 


0.9944 


/x=(0,0)^ 


H 


0.0200 


0.0171 


0.0193 


0.0103 


a=f.5 


W 


0.0664 


0.1207 


0.3419 


0.8428 


fi={0,Of 


H 


0.0207 


0.0168 


0.0182 


0.0172 


o" = 2 


W 


0.f082 


0.2439 


0.6123 


0.9135 


/i=(0.2,0.2)^ 


H 


0.0f89 


0.0201 


0.0196 


0.0240 


o-=f.5 


W 


0.07f0 


0.1297 


0.3495 


0.8249 


^ = (1,1)^ 


H 


0.0741 


0.0814 


0.0865 


0.0943 


cr=f.5 


W 


0.1088 


0.2188 


0.4925 


0.8462 


/.=(2,2r 


H 


0.2356 


0.2546 


0.2690 


0.2716 


cr=f.5 


W 


0.2092 


0.4139 


0.7395 


0.9259 


/I = (0.2, 0.2)^ 


H 


0.0248 


0.0186 


0.0217 


0.0158 


o" = 2 


W 


0.1134 


0.2401 


0.5990 


0.9151 


/^=(i,ir 


H 


0.0575 


0.0616 


0.0623 


0.0676 


0" = 2 


W 


0.1330 


0.2797 


0.5619 


0.8272 


/.=(2,2r 


H 


0.1796 


0.1936 


0.2045 


0.2164 


cr = 2 


W 


0.1771 


0.3513 


0.6531 


0.8981 



OosterhofF and van Zwct [32] proved that {Qj^ } is contiguous with respect to {Pj^ } 



if and only if 



and 



N 



liiR avLp^H^{PNk,QNk) <oo 



N^oo 



fc=l 



lim y^QNki 



gNki^Nk) 
PNk{XNk) 



> Cat > = ycM — > oo, 



(A.l) 



(A.2) 
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r 1^/^ r /■ 



1/2 



is the HcUinger distance oi P,Q. 

Put An = TV^^/^Ao with Aq > fixed. Applying (A.l) and (A.2), we can ver- 
ify the contiguity of the sequence {IlfeLi ^AN(-^fc) Ilfc^m+i ^Airl-^fe)} '^^^^ respect to 



tN 



{Y[k=i-^(-^k)} for the alternatives (3.3), (3.4) and (3.5). 
Lemma A.l. (i) Let 



' N 



2i,...,zw>0, Af = l,2,.. 



.fc=i 



N=l 



and 



N 



lfe=l fc=m+l J N=l 

he two sequences of probability distributions satisfying 

An=N-^/^Ao>0, 



zi,...,ZN>0, N = l,2,.. 



(A.3) 



(A.4) 



lim min{TO, n} = oo, 



lim — = lim ^^ = AG (0,1), 

where G]^ ,G}^ are given by either (3.2), (3.4) or (3.5). The sequence (A. A) is then 
contiguous with respect to the sequence (A.3). 

Proof, (i) Let us first consider the Lehmann alternatives (3.2). Then, 

Af 

Y, H\F{zk),GAA^k)) 



k—m-\-l 



f{z)[^l + AN{2F{z)-l)-lfdz 



:nl f'r) [l + A.(2n.)-l)-iP ,., 
'o '[Vl + Ajv(2F(z)-l) + l]2 



<nAl f{z){2F{z)-lYdz 

Jo 



■AnA% 



= -nApf = -XnAo < oo 
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and 



N 



\ qNkjXNk) 



V Y^^ J 1Nk\^Nk . 

lim > QNk\ jrp — r > cn 

^^°°r^ lPNk{XNk) 



k=l 

N 



= 0+ lim V / /[l + Aw(2F(zfe)-l)>cw] 

X [1 + AAr(2F(zfe) - l)]/(2fc) dZfe = 

because cat > 1 + iV^^/^Ao for n> Nq whenever cat — > oo. The contiguity is thus verified. 
(ii) Let 

Then, 

N 



r'oo 
- m 
/o 

/•GO 



/(z)[v/(l + A^)(l-F(z)f"-l]^dz 



+ n-J fiz)[^il + AN){F{z))^-~lfdz 



< m • / /(z)[(l + AAr)(l - F(z))"" - 1]^ dz 
Jo 

/•CJO 

+ n. / /(z)[(l + Ajv)(F(z))^"-l]2dz 

= m- f [{1 + An){1-u)^'' -l]^dz + n- f [{1 + An)u^" ^ 1]^ dz 
Jo Jq 

^N- I [(l + AAr)u'^"-l]^dz<AAr<oo 
Jo 

and hence (A.l) is proved for the alternative (3.4). Concerning (A. 2), we have 
im yQNii 7T^^ 



>CN 



: lim m- / /[(l + Ajv)(l-F(z))^">cw](l + AAr)(l-F(z))^"/(z)dz 

+ n- I[{1 + An){F{z))^- >cn]{1 + An){F{z))^- f{z)dz 

Jo 



Nonparametric multivariate rank tests 21 

= lim N- I lUl + An)u'^'' > cn](1 + AnU^" du 

JV->oo Jo 

/•l+Ajv 

= lim N- I[v > cnV^^" Ajj^il + An)-^^^'' dv ^0 

N-too In 



because the set {v : cn < v < 1 + An} is empty for N > Nq. 
(iii) Similarly, for the alternative (3.5), we have 



N 



Y, H'{F{zk),GAA^k)) 



fc— 771 + 1 



: n 



f{z)[^il + AN)F^-{z)^lfdz 



n r fiz)l^^M£^m^^dz 
Jo 'W{l + AN)F^«iz) + l]^ 



<n [ [(1 + AAr)u'^" - 1]2 du<n f [A^ + (m'^" - 1)^] du 
Jo Ja 

^l+2A„ 2^1+'^" "• ^ 



<n{A]^ 



1 + 2AAr 1 + An 

2 ?\ __ A 2 



7llAl ' ^^^ 



N 
' 



(l+2AAr)(l + A„) 



<7nA^ = 7AArAo < oo. 
Condition (A. 2) is verified analogously as for the alternative (3.2). D 
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